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MICROPHONE INPUT 
(57) Abstract 

An apparatus that automatically adjusts the adaptation block size for a least-mean square (LMS) adaptive filter depending on the 
input signal-to-noise ratio (SNR) is disclosed. The apparatus monitors the instantaneous SNR (22) and continually adjusts the block size 
(20, 26) to provide high noise immunity, thereby increasing the convergence speed of the filter and decreasing the asymptotic mean-square 
error. An exemplary embodiment of the present invention is presented in the context of acoustic echo cancellation, though it is noted that 
the adaptive filter of the present invention is useful in any environment in which the noise characteristics are subject to change. 
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A VARIABLE BLOCK SIZE ADAPTATION ALGORITHM FOR 
NOISE -ROBUST ACOUSTIC ECHO CANCELLATION 

BACKGROUND OF THE INVENTION 

5 

I. Field of the Invention 

The present invention relates to communication systems. More 
particularly, the present invention relates to a novel and improved 
10 adaptive filter wherein the number of consecutive samples over which an 
averaging procedure is performed to adjust the tap values of the adaptive 
filter varies in accordance with the noise content of the channel upon 
which the adaptive filter operates. 

15 II. Description of the Related Art 

Acoustic echo cancellers (AEC) are used in teleconferencing and 
hands-free telephony applications to eliminate acoustic feedback between a 
loudspeaker and a microphone. In a mobile telephone system where a 

20 vehicle occupant uses a hands-free telephone, acoustic echo cancellers are 
used in the mobile station to provide full-duplex communications. 

For reference purposes, the driver is the near-end talker and the 
person at the other end of the connection is the far-end talker. The speech 
of the far-end talker is broadcast out of a loudspeaker in the mobile. If this 

25 speech is picked up by a microphone, the far-end talker hears an annoying 
echo of his or her own voice. An acoustic echo canceller identifies the 
unknown echo channel between the loudspeaker and microphone using an 
adaptive filter, generates a replica of the echo, and subtracts it from the 
microphone input to cancel the far-end talker echo. 

30 A block diagram of a traditional acoustic echo canceller is shown 

below in Figure 1, where the echo path has been shown using dashed lines. 
The far-end speech x(n) is broadcast out as loudspeaker output and passes 
through the unknown echo channel 6, which is illustrated as an element 
though its existence is simply an artifact of the near-end microphone's 

35 colocation with the near-end loudspeaker, to produce the echo signal y(n). 
The near-end microphone input receives the sum of the echo signal y(n), 
channel noise w(n) and near-end speech v(n), the summations of which are 
shown by means of summing elements 8 and 10, which are purely for 
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illustrative purposes. The near-end received signal r(n) is a sum of the echo 
signal y(n), channel noise w(n) and near-end speech v(n). 

When the far-end talker is the only one speaking, the filter 
coefficients represented by vector h(n) are adapted to track the impulse 
5 response of the unknown echo channel. Adaptation control element 2 
receives the error or residual signal e(n) and the far-end speech x(n) and in 
response provides a tap correction signal to adaptive filter 4. The adaptive 
filter 4 receives the tap correction signal and corrects its filter tap values in 
accordance with the tap correction signal. In accordance with the adapted 
10 filter coefficients h(n) and the far-end speech signal x(n), adaptive filter 4 
generates a replica of the echo, y(n) which is provided to subtraction 
element 12. Subtraction element 12 subtracts the estimated echo y (n) from 
near-end received signal r(n). 

Typically, the algorithm used to update the filter tap coefficients that 
15 track the echo path response is the least-mean-square (LMS) adaptation 
algorithm. The filter order is denoted as N and the far-end speech vector 
x(n) is represented as: 



20 



x(n) = Ix(n) x(n-l) x(n-2) . . . x(n-N+l)], (1) 
and the filter-tap coefficient vector is represented as: 

S(n) = rh Q (n) h^n) h^n) . . . h N-1 (n)J. (2 ) 

25 As each new sample r(n) is received, the algorithm computes the echo 
estimate y (n) based on its current filter taps: 

N-l 

?(n)= <h(n) x(n)>. £h.(n)x(n-i). (3) 

i=0 

30 This estimated echo signal y(n) is subtracted from the near-end received 
signal r(n), so that the echo residual is given by: 



e(n) = r(n)-£(n). 
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The adaptation algorithm is disabled when the near-end talker is 
speaking, so that the tap coefficient vector is then updated as: 

h(n+l) = h(n) + a e(n) x(n) (5) 

5 

where a is the adaptation step size and the error signal in the absence of 
near-end speech v(n) and noise w(n) is given by: 

e(n) = y(n)-y(n) (6) 
10 The LMS algorithm derives its name from the fact that it attempts to 

minimize the mean of the squared error: 

MSE(n) = E[e2(n)]. (?) 

15 The LMS algorithm is also called the "stochastic gradient" method because 
an approximation to the gradient of MSE(n) with respect to the tap vector is 
given by: 



8MSE(n) CT 3. (8) 

3h(n) 

20 

Since the gradient indicates the direction that the mean square error 
increases most rapidly, each tap update is steered in the opposite direction of 
the gradient by adapting the tap values in relation to the inverted gradient. 
The main advantages of the LMS algorithm are that it requires less 
25 computation than other adaptive methods and its stability can be 
guaranteed by proper choice of step size. This algorithm executes on a 
sample-by-sample basis; that is, the tap vector h(n) is updated with each new 
sample. 

An alternative implementation, called the block LMS algorithm, 
30 updates the tap vector using a block of L samples. As before, as each new 
sample r(n) is received, the algorithm computes the echo estimate y (n) and 
the echo residual signal e(n). However, instead of immediately updating 
the filter coefficients, the algorithm averages L consecutive instances of the 
negative gradient e(n)x(n) (the "2 H in the gradient expression has been 
35 absorbed into the step size a) and updates the coefficient vector h(n) once 
per L-sample block. The block LMS algorithm can therefore be expressed as: 
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a L-1 

h((n+l)L) m h(nL)+ j- £ e(nL+j)x(nL+j). 

j=0 

Notice that if L=l, this equation reduces to the sample LMS presented 
in equation 5, so the sample LMS algorithm can be considered to be a 
5 degenerate case of the block LMS algorithm. The advantage of choosing a 
block size L greater than 1 is realized when noise is present. As shown in 
Figure 1, any noise w(n) present in the echo channel is added to the echo 
signal y(n) and therefore appears in the error signal: 

10 e(n) = y(n) + w(n) - y (n). ( 

Therefore, the direction of each sample gradient is perturbed by the 
noise, which causes the sample (L=l) LMS algorithm to have a longer 
convergence time and a larger asymptotic mean square error. However, by 
15 choosing L>1, we average L consecutive instances of the gradient to 
achieve a more accurate estimate because the positive and negative noise 
samples will tend to cancel each other out during the averaging process. 

SUMMARY OF THE INVENTION 

20 

The present invention is a novel and improved adaptive filter that is 
more robust to environments that have varying noise energies. An 
exemplary implementation of the present invention is presented in an 
exemplary embodiment of an acoustic echo canceller. 

25 When the noise w(n) is small compared to the size of the echo, the 

sample LMS (L=l) converges more rapidly than the block LMS (L>1) 
algorithm for the same step size a. As the noise increases in amplitude, the 
optimum block size L', for maximum convergence speed, also increases. 

In the present invention, a method and apparatus are presented that 

30 adjust the block size L responsive to the noise content on the channel. In a 
preferred embodiment the block size L is adjusted in response to the 
instantaneous signal-to-noise ratio (SNR). In the exemplary 
implementation of the present invention, an echo canceller is disclosed that 
comprises an adaptive filter the taps of which are adapted in accordance 

35 with the variable block size LMS method of the present invention. 

In the exemplary embodiment of an echo canceller, an adaptive filter 
generates an estimated echo signal y (n), which is subtracted from the near- 
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end received signal r(n) to provide a residual signal e(n). The noise 
composition of the channel is monitored, and in accordance with the noise 
composition of the channel an adaptation block size L is selected. The 
adaptive filter tap values are then corrected or adapted in accordance with 
5 the far-end speech x(n), the residual signal e(n) and the adaptation block size 
L as shown in equation 9. 

Although the exemplary implementation of the present invention 
takes the form of acoustic echo cancellation, it is envisioned that the scope 
of the present invention extends to use in any environment in which 
10 adaptive filters are employed and the channel noise characteristics are 
subject to change. 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 The features, objects, and advantages of the present invention will 

become more apparent from the detailed description set forth below when 
taken in conjunction with the drawings in which like reference characters 
identify correspondingly throughout and wherein: 

Figure 1 is a block diagram of an echo canceller employing a 
20 traditional fixed block size LMS algorithm; and 

Figure 2 is a block diagram of an exemplary implementation of the 
present invention of a variable block size LMS algorithm within an acoustic 
echo canceller. 

25 DETAILED DESCRIPTION OF THE PREFERRED 

EMBODIMENTS 

In the present invention, a method and apparatus are presented that 
adjust the block size L responsive to the noise content on the channel. In a 
30 preferred embodiment the block /size L is adjusted in response to the 
instantaneous signal-to-noise ratio (SNR). Ideally, the signal being referred 
to in the instantaneous SNR is the echo signal, such that the signal-to-noise 
ratio at time n, SNR(n), is computed as: 

35 SNR(n) (dB) = 10 logiot E y (n)/E w (n) ], (11) 

where E y (n) is the energy of the echo signal at time n and E w (n) is the 
energy of the noise signal at time n. 
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However, since the actual value of y(n) is unknown at the filter, the 
echo signal energy Ey(n) can be approximated as: 

N 

Ey(n)= £[r(n-i)] 2 (12) 
i=0 

during periods where the far-end talker is the only one talking. Similarly, 
since the noise signal w(n) is unknown at the filter the noise energy Ew(n) 
can be computed as: 

N 

10 Ew(n)= X[r(n-i)]2 (13 

i=0 

when both the far-end and near-end talkers are silent. Using the 
approximations in equations 10 and 11, an approximation of the signal to 
noise SNR(n) ratio of equation 11 can be computed as: 



15 



Sl<*R(n)« 101ogi 0 [Ey(n)/ E w(n)] (14) 



Referring now to Figure 2, speech detection element 30 monitors the 
energy of signals x(n), r(n), and e(n) to determine when the far-end talker is 

20 the only one talking and when neither talker is speaking. Speech detection 
element 30 provides control signals to the SNR computation element 22. 
SNR computation element 22 also receives the near-end received signal r(n) 
and computes Ey(n), Ew(n), and S&R(n) as given above, responsive to the 
control signals from speech detection element 30. SNR computation 

25 element 22 provides S&R(n) to block size selection element 20, which 
selects the adaptation block size L in accordance with sftR(n). Block size 
selection element 20 provides the adaptation block size L to adaptation 
control element 26. 

Adaptation control element 26 receives far-end speech x(n) and error 

30 signal e(n), in addition to the adaptation block size L and in accordance with 
these input signals determines filter tap correction values c(nL) as follows: 

a L " a 

c(nL)=j- ]T e(nL+j)x(nL+j). (15) 
j=0 
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The filter tap correction values c(nL) are provided to adaptive filter 28 by 
adaptation control 26. In response to the fUter tap correction values c(nL), 
adaptive filter 28 generates corrected filter tap values h((n+l)L) as: 

5 h((n+l)L)= h(nL)+ c(nL). (16) 

Adaptive filter 28, also, receives far-end speech signal x(n), and generates an 
estimate of the echo signal y (n) in accordance with the corrected filter tap 
values h((n+l)L) and the far-end speech signal x(n). The estimated echo 

10 signal y (n) is then subtracted from the near-end received signal r(n) by 
subtraction element 36. 

In the exemplary embodiment the present invention has been 
described in the context of an acoustic echo canceller. This is a particularly 
useful application of the present invention since the noise in a car 

15 continually changes owing to many factors, such as vehicle speed, 
smoothness of the road, weather conditions, varying external noise, and 
whether the car windows are up or down. For example, the driver may 
initiate a call while sitting in a quiet parked car where the apparatus of the 
present invention would set L equal to 1 for fastest convergence. When the 

20 driver starts the car and revs the engine, the machine would detect the drop 
in SNR and automatically increase L, to say 32. While driving through a 
quiet residential area, the apparatus of the present invention may decrease L 
to 16, and upon entering a bumpy freeway, the apparatus of the present 
invention may again increase L to 64. This automatic block size selection 

25 for fastest convergence is important, because the adaptive filter must be 
continually updated to account for changes in the acoustic channel between 
the loudspeaker and the microphone. 

An alternative embodiment of the present invention comprises a 
plurality of adaptive filters each of which employs a different averaging 

30 length for adapting the filter coefficients. An output source is then 
dynamically selected from the outputs of the bank of adaptive filters. In yet 
another alternative embodiment, instead of varying the block sizes directly, 
temporally staggerred blocks of one size may be used. 

Although in the exemplary embodiment of the present invention is 

35 presented in the environment of an acoustic echo canceller, it is applicable 
in any environment in which adaptive filters are employed and the 
channel noise characteristics are subject to change, such as network echo 
cancellation and channel equalization. 
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The previous description of the preferred embodiments is provided 
to enable any person skilled in the art to make or use the present invention. 
The various modifications to these embodiments will be readily apparent to 
those skilled in the art, and the generic principles defined herein may be 
5 applied to other embodiments without the use of the inventive faculty. 
Thus, the present invention is not intended to be limited to the 
embodiments shown herein but is to be accorded the widest scope consistent 
with the principles and novel features disclosed herein- 



10 WE CLAIM: 
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CLAIMS 

1. An adaptive filter comprising: 

2 block size selection means for determining and providing a variable 

adaptation block size value; 
4 filter coefficient computation means for receiving said variable 

adaptation block size value and for determining and providing at least one 
6 filter coefficient value responsive to said variable adaptation block size 

value; and 

8 filter means for receiving said at least one filter coefficient value and 

for filtering a signal in accordance with said at least one filter coefficient 
10 value. 

2. The apparatus of Claim 1 further comprising noise 
2 computation means for monitoring noise content of a communications 

channel and for providing a signal indicative of the noise content of said 
4 communications channel; and 

wherein said block size selection means is responsive to said signal 
6 indicative of the noise content of said communications channel. 

3. An echo canceller for canceling an echo signal of a far-end 

2 speech signal, comprising: 

block size selection means for determining and providing a variable 

4 adaptation block size value; 

filter coefficient computation means for receiving said variable 
6 adaptation block size value and for determining and providing at least one 
filter coefficient value responsive to said variable adaptation block size 
8 value; 

filter means for receiving said at least one filter coefficient value and 
10 said far-end speech signal and for providing an estimate of said echo signal 
in accordance with said far-end speech signal and said at least one filter 

12 coefficient value; and 

difference means for subtracting said echo signal estimate from a 
14 near-end received signal to provide a residual signal. 

4. The apparatus of Claim 3 further comprising noise 
2 computation means for monitoring noise content of a communications 

channel and for providing a signal indicative of the noise content of said 
4 communications channel; and 
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wherein said block size selection means is responsive to said signal 
6 indicative of the noise content of said communications channel. 

5. The apparatus of Claim 4 further comprising speech detection 
2 means for detecting said far-end speech signal and a near-end speech signal 

and for providing a control signal responsive to the presence of said far-end 
4 speech signal and said near-end speech signal; and 

wherein said noise computation means is responsive to said control 

6 signal. 

6. A method for adaptively filtering a signal comprising the steps 

2 of: 

determining a variable adaptation block size value; 
4 determining and providing at least one filter coefficient value 

responsive to said variable adaptation block size value; and 
• 6 filtering a signal in accordance with said at least one filter coefficient 

value. 

7. The method of Claim 6 further comprising the steps of 
2 monitoring noise content of a communications channel and providing a 

signal indicative of the noise content of said communications channel; and 
4 wherein said step of determining a variable adaptation block size 

value is responsive to said signal indicative of the noise content of said 
6 communications channel. 

8. A method for canceling an echo signal of a far-end speech 
2 signal, comprising: 

determining and providing a variable adaptation block size value; 

4 determining and providing at least one filter coefficient value 

responsive to said variable adaptation block size value; 

6 providing an estimate of said echo signal in accordance with said far- 

end speech signal and said at least one filter coefficient value; and 

8 subtracting said echo signal estimate from a near-end received signal 

to provide an echo canceled near-end signal. 

9. The method of Claim 8 further comprising the steps of 
2 monitoring noise content of a communications channel and for providing a 

signal indicative of the noise content of said communications channel; and 
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4 wherein said step of determining and providing a variable adaptation 

block size value is responsive to said signal indicative of the noise content 
6 of said communications channel. 

10. The method of Claim 9 further comprises the step of providing 
2 a control signal responsive to the presence of said far-end speech signal and 

a near-end speech signal; and 
4 wherein said step of providing a signal indicative of the noise content 

of said communications channel is responsive to said control signal. 
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